Granger causality and transfer entropy are equivalent for Gaussian variables.

نویسندگان

  • Lionel Barnett
  • Adam B Barrett
  • Anil K Seth
چکیده

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Equivalence of Granger Causality and Transfer Entropy: A Generalization

Barnett et al. in 2009 proved that Granger causality and transfer entropy causality measure are equivalent for time series which have a Gaussian distribution. Granger causality test is linear, while transfer entropy a non-linear test. Many biological and physical mechanisms show to have non-Gaussian distributions. In this paper we investigate under which conditions on probability density distri...

متن کامل

Relating Granger causality to directed information theory for networks of stochastic processes

This paper addresses the problem of inferring circulation of information between multiple stochastic processes. We discuss two possible frameworks in which the problem can be studied: directed information theory and Granger causality. The main goal of the paper is to study the connection between these two frameworks. In the case of directed information theory, we stress the importance of Kramer...

متن کامل

The Relation between Granger Causality and Directed Information Theory: A Review

This report reviews the conceptual and theoretical links between Granger causality and directed information theory. We begin with a short historical tour of Granger causality, concentrating on its closeness to information theory. The definitions of Granger causality based on prediction are recalled, and the importance of the observation set is discussed. We present the definitions based on cond...

متن کامل

Transfer Entropy Expressions for a Class of Non-Gaussian Distributions

Transfer entropy is a frequently employed measure of conditional co-dependence in non-parametric analysis of Granger causality. In this paper, we derive analytical expressions for transfer entropy for the multivariate exponential, logistic, Pareto (type I − IV) and Burr distributions. The latter two fall into the class of fat-tailed distributions with power law properties, used frequently in bi...

متن کامل

Simulation Study of Direct Causality Measures in Multivariate Time Series

Measures of the direction and strength of the interdependence among time series from multivariate systems are evaluated based on their statistical significance and discrimination ability. The best-known measures estimating direct causal effects, both linear and nonlinear, are considered, i.e., conditional Granger causality index (CGCI), partial Granger causality index (PGCI), partial directed c...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Physical review letters

دوره 103 23  شماره 

صفحات  -

تاریخ انتشار 2009